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ABSTRACT : PROBLEM TO BE SOLVED: To provide an image processing method, ah image 

processing apparatus and a recording medium that can suppress noise and emphasize 
sharpeness in a digital image without causing an unpleasant unevenness due to the noise 
and an unnatural artifact or the like. 

SOLUTION: Sharpness emphasis, smoothing and edge detection are applied to original 
image data, edge and noise intermingled image data of an object are obtained from the 
obtained sharpness emphasis image data and smoothed image data, a noise weighting 
coefficient is obtained from edge emphasis data obtained by the edge detection, noise 
data are obtained from the weighting coefficient and the intermingled image data, a noise 
suppression distribution function denoting the spread of noise suppression is set, 
convolution integral is applied to this function and the noise data to calculate the noise 
suppression distribution, a noise suppression component is obtained by multiplying the 
noise data with the noise suppression distribution and the component is magnified and 
subtracted from the sharpness emphasis image data to obtain processed image data so 
as to solve the tasks above. 
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frfoix&tQMb LTi±. fiX^W) SS&^if 

tm*m?h z± h . 

[ 0 0 2 6 J BH^E-? • B{&S5Ji^X-?l£5£g&2 
. 2ti. B^-^tiJ:l^H«5ra/^5X-^^gp*^ 
3: 9. B&^-^tcBfcA^Sl 2fj\hX^ixtzX 
^JB^x-^tc«o'^TA*B«S:a^-f & k k t> .te. 
££>Hflt*=-**JBvvc (t«i.{fGU I ^rk'tioT) 

mjasi^ajr^M-r^ fci^co y w xnmwmmm 2 0 
■cff a =s-a?)B<£5ai!co; y — ^ & l*c ^ x 

*Mf— *K— K=5rt*cO-r-^A*«8tcJ: otirfl,^ 

C0027 j x&w^mm&jmtmm-z s -r xjw 

©IB&5&SSS (felT. *tc*Sffi*!USg|5i: v»p ) 2 0 
ii. • P^IMSP 1 8T-^«$fL^iEB«T-^ I o 

w&tmzfti x . mwna^mm 1 6 tcai^j-r-g. Jtfeo 
mmmw&T-fxbhwmt&T-? i x £.fl^-r 
&t&><7)i><z>X'hh . 

[0028] zzx\ *mmwMU2oi*. mziz^-t 
£oiz. mmm?-? i 0 t-^-r^x^p^aasrfi 1 

ot, B<lkkU^<^B&4Hc#£:ft&^£ktti6 

k-rsy-rx (stfp) tfc»«fl:Lfc^^-r^BiW 

Btfcx-? I s 2rff^r§^^-7*^x3feiiSaS^2 4 

k. isifif-^ i 0 (^jf^tJJiya^^ToT, ^-fbB 
-*i 0 ^^mimm.T'-^i^mMLx. 

B&OX-y i?b J -i XbWm&thlS&.W&.'f— 9 A I 



mm?-? i o*^s^«r®«^ y ^ta^^x. 

g^flOC -y i^igk y 4 Xf»£k ^^glJ-T ^ fcftOX y 

i^JSx-^E 0 Sr^^x-y^aiSSBOfc. -IOX 

y XfSiSm^&iliggB 32L i^'- y 
4 Xgffi^^ftaJSP 2 8 T-lf^ilJtigffiBtfex- * A I 
K G tc y 4 Xfi^^RSSLgB 3 2 ^ft/vi y 4 X®^ 

? G 0 $:*^>S y >f XtiiRm§»mR 34 MM&rf 

-5 1 o izmfz y-f xsp$ij<7)/s*^ ^^-r y -i xm\ 
ttifim®. s , £ ? UE3i[ LTis^-r s y >f xw#j#:ffiB8»t& 

^gP 3 6 k y >f XjS^^giJ^SISB 3 4 T*i6fey -f. X 
x-^ G 0 . k y-f Xffp^J^-^liBIStiS^gp 3 6 -eifcjg L^r 

y-fxjtpM^-^ijM^s, k^s^a^s^-Srffoxy-f 

s ) m zmm- Lx&fr & y >f x^& h;i4qKH^«surff 
(*^j(ctj{t^y-( x?p$o^sisa5tffla > 3 8 

k , y -i X^e h /HQffil^aUKSK 3 8 T-3<*> A-futy^f 

x^e h/w«i$ij^M zsjx&frmmimz 4 

■ y A X^r- ? Go ZtliZX-yX . J 4 Xffl 

$iM*B«x-^ Gi Srfliai^S y XfPSiJBg^Sgp 

40k. sjxmmttmm&Aox'm.&ztvrzS'ix 
m&2 4X'&fr^titiis*-y-*x3&mmm s f-? i s 

BfilJiJ^^Sl e^JSL^iSMBm^-^ 

i , tzsstot* y xw$ij^s:^ssf54 2 k ^^r-r ^> . 
[0029] H2^-ry 4 xwj • ^-t—y^x^p 

B«i!aS^2 0{i. S*Wt^Xt<0i3tC«fi!c$tLl». 

B 3 ic*-r*%HjcoB^a*«^ST^^y 

[0030] *5lte^(Ct>^TJi. 03^-rctdtc. 
B*fttc5fe-T. «f-^ I 0 ^-v— 
PJ0agP2 4tCt>V^v-r-X^X^Iii3MS:fi : V> (X 
T7710 0) . >-v-X^X3iii®mT-^ Is Sr 

ft. ¥mitw&&2 6iz&\,^x¥miwm$:?T^ (xt 

77102). -^jt-fLBM-r— ^ I AV £#. x 7 y .-. y 

-fXii^^ttajgP2 8iz&\,->x~>*-7*x&mzti 

7 A I EC $r}ftai-r-S> (Xf77104) . 
[0031 ] X -y iStfUXK 3 0 ICfc V>T1SB^ 

i o-a»&*s*x .y ^-^k y ^ x«j£k SriEsw- 

i,/c^X yi^jgx-^^E 0 Sr^TX y z/miiiZft 
^Uf77106) . y-fX«^*^«8acSB3 2 
^fcv^T. y4Xg|*£Ofi*tttt«£StW G ^fi-^LT* 
tf>^. UT77-108) . S^c. y-YXBE^-^sq^fB 

s?3 4tcfc^-c. y-fx^-^^msg-^-gts-^d (x 

f771 10). -T^ri>^. ^«B«x-^A I E6 tc. 

y >f xa^^aaisLas 3 2 x^^^y x®iSco« 
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i o o 3 2 1 iRK: . ; i xwfflmmmm&&3 6 \z& 

xvmvtmm. s , t co^a. ff^ty-fxt 
htmm^M^ib (xf77i i2). sjxnm 
tfiftmmmA oiz&ux. jax^ V)vw&-9tw z j 

4X^r—?G 0 tc^SL-rs^fc'^JroT , V ■< XJTp$iJj£ 
fl-B&T-rJ'G, ^JTLTgtBL (^X^H/l/WJ 

^oss:^^) Uf7rii4) . s^xnffl®. 

SJ0 ; Sa54 2tCfcV^T. S^-r- ^-X^Pi!^S82 4T' 



6). 

[0033] #S^Jtoffi{BJ^:fr^Jbj*L^# 

m<o>>*— y*x*mmthmkt txa. r^t- 

7~?;*?(Unsharp masking. USM) S tzityy? isTXL 
aplacian) tf&<%3t>tlX l">&. ^IfcHJHciJ l vC t . CI 

m%i><vx'$>ttif.wm<?>>'*-y'*x$:&m-t&z.t 

[0034] TVyt-rvx^li tfSfrDidtcii 

®x-?io<x.y) (as-rssstftg*. x ^j^y 

-^S ) fr$> . I o (x.y) Si ^±BT*» L*: 

4 .x.y)*g|V^T^fcX-v^5SWBE»Io-(x.-y)- I 
av (x,y) {C^Sa^tTi^H^-^ I 0 (x.y) tCjD 
JW-iifcfci-at. TB* <4')-£>J:3fc:. i^r- X 

^anmftis (x.y) ^^h^mx-^. 



t 
i 



i s (x;y) = i 0 (x.y) + a C r 0 (x.y)- lav x,y)3 



577^11 liif-? I o (x.y)OZl£K$& 
# ( 577v.7» V* I 0 (x,y) £®H«X-* I , (x. 

i s (x.y) = i.o (x.y) -v* i 
v~r=7^rv\tii s isv-y*x&m<7>m&m%mt l 

T (i. TICsS (6) ^^3X3 O^gcffi^J*^ < m 

0 -1 0 -1 -1 -1 
-1 5 - 1 -1 9 -1 
0-1 0 -1 -1 -1 

[00 35] zvxmMMX'ii: mzm^^-y^x 

G(x,y) = (l/2*r<r 2 )exp[-(x J 

X'foK). ~?X7c?>ffix = x 1 lZi5lihmb^X?cv$»b 

G(x 1 ,0)/G(0.0)=exp(-x,V2 <? 2 ) 
WO. 1 — 1 . 0i:^:i.J:o(-pfi5-r5C:i:tcJ;-?T. 
3 X 3cr>Ty>--Y— TVX^cOy-v:- X$£/3tMc7>i>c7) 
£ .T fc h . & ( 8 ) <7tei: 1 . 0 fcifft ifcfc: 
5$ (5) .*0>MW)?7?i/7y7^^{:«ff- 

E(x,y)=ex P (-(x 2 + y 2 )" 2 /a) 



y)H?l<IttJ:ot. 
0 (x,y) 



(4) 



(5) 



1-2 1 
-2 5-2 (6 ) 

1-2 1 

IZ. *%mX'lil£ (7 ) tC*L7cio^iE«7)- : ffiS(Gau 
ssian)<7)&'H-W$t£ffl \^tiT>.^ Y-77X ? SrfflV>& 



y*)/2<*») 



(7) 



(8) 

#S>9. fci:*JBf5x5. 7X7. 9x9f<7)-7^^5: 

fMSi5:£ *.mtz$8£t h Z t WX'Z Z . 
[0036] ttz. ~?X7com&BtLXi>. IMicoiE 

m»itimme>i><o. tztm. Tte^ <a) co±o% 

(9) 



^^T*;,a(i5* (8) Oct 4 hl»l«(cr y-/t-7?X 

. E(x, , 0) /E(0. 0) =exp( -xj a ) 
**0. 1 — 1. OtKZXolzmVB-t&ZtteJi'oX. 
3 x 3W>'yA'-77X?tf)y'V-7$?:BlflWt<0 
tf^Clk^-C^-S. *(10)t. E(x,.0)/E(0.0) = 

0.18 0.30 0.18 
0.30 1.00 0.30 
0.18 0.30 0.18 



(10.) 

o .3t l*z t z<r>& ( 9 ) cr>mm&<?>^x?<m.m\ 



(11) 
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-0.12 -0.22 -0.12 
-0.21 2.32 -0.21 
-0.12 -0.21 -0.12 
[00 3 7 ) 3^7^^-7-7X7 JrlW, 

Is (x.y) £3Ctt>&ZttfX'ZZ>. *fKBt£ffl^ 
fc^>A/C*S. 04 (a) Xy^MSEW 
c\blz£~>X. 124 (b) iz^Zoiz, mmEi 

^'ofi-t*^ii$^-s> 1 1 tic is&a. jhnb tj.«ti/ 

Uv(x;y) = -V I X WCij) • Io(x+i 
n i=l j=l 



#3S ( 1 2) 

(12) 

[0038] a*:, spmftjom (xf77*io2 ) ic-? 

fck «^^Sfc^fflv^^-fbo^raT-«±TIB^ (13) 
£*{f£ CI ^fc. •iCT. (x.y),^ti. ® 

[iSC 1 ] 

-f-Y •v + j f-iKi3) 



[00 39]7t*5U nJi^^fbOVX^^X. w 
(x.y) {iJi^ScT-J>S. w(x,y) =1. Ob+Zb* 

mmw-&ik%&. *mixii. m^mmmm<r>^x\~ 
jmft^m<vn*&&tmifx^m£3itf>&ijm$:m 
v^a^ ztiizmfeztiftiy. z<7)&f. xm<?>-?x7k 

LXii. TISOJ; 3inx ni^vx^Jfflui,^ 
Ly\ *{#W::{±3 x 3K5X5. 7 x 7 % 9 x 
9fegcot<7)SrfflV^£0* s »i U\ 

Wll Wj2 W! 3 W,„ 

0.09 0.15 0.22 0.28 0.30 

0.15 0.26 0.38 0.47 0.51 

0.22 0.38 0.55 0.69 0.74 

0.28 0.47 0.69 0.86 0.93 

0.30 0.51 0.74 0.93 1.00 

0.28 0.47 0.69 0.86 0.93 

0.22 0.38 0.55 0.69 0.74 

0.15 0.26 0.38 0.47 0.51 

0,09 0.15 0.22 0.28 0.30 

[004 1] I^^VX^JlV^T. 

Io(x,y)*^^-fkffl«x-7 I AV (x,y) .It 

**-es&. *t$. ^^mizm^ith^miUjmt lx 

14. ±.i£Lfi:m«cr)1jmizm%.Zti&t>iiXl±%<. ft. 
T-i>3rV^ 04 ( c ) 04 ( a ) K^il&ru 

-ktssi xmmco j a xs&fttfwm s tim t>nHz* h t 



«21 W 22 W 23 W2 n 

"31 "32 "33 

.... . ( 14) 

w nl w n2 w n3 «U 

[004.0] 9x9BScovx?c7)— 0g$r^-T. ZcoiH 
(15) -eii4>4>Wtt£ 1 . OizjEMittfzMX-^kLX 
mf£cr>%mx*li'?x7£:ftcr>m < l Qlz%& 

0.28 0.22 0.15 0.09 

0.47 0.38 0.26 0.15 

0.69 0.55 0.38 0.22 

0.86 0.69 0.47 .0.28 

0.93 0.74 0.51 0.30 ( 1 5 ) 

0.86 0.69 0.47 0.28 

0.69 0.55 0.38 0.22 

0.47 0.38 0.26 0.15 

0.28 0.22 0.15 0.09 

/V-$mb%iX^i>Zbtim&. 

[0042] ifcwr, y-fxs^^ttajx 

gUf7710.4) iz^XWmth. ^Fft-fLXS 

(XT77102) xn^tvfz^mmm'r- *-i„ (x, 
y) tie*; (16) izfcix. is*- r^x^mr 
g(xt77ioo) xi%t>tifz^-7'*xwmfSi 

ts4x<r>mm-hmMmm.?-?x'hhm&m* i 
eg (x.y) £ttai-r&. 
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A Isofo.y) — I o (x.y) - 
04 (d) tzii, 04 (b ) fcttf ( c ) X'ijiZtl&y 

[0043] mz^ Xyi^tBlfl (^f'/T-l 0 6 ) 

iz^xmmtz. zzx-a. -mt Lxmm#f&tt 
izx&^yV&mzKmit LxmR-r&tiK *&wu 
ztiizmfczti&mx'te*^. 

[ 0 0 4 4 ] x >y iSm&Z'U o mtzft? . OTO i o 3: 
D w =(rD, +gD c +b 
a»fiR»fc tftt, r : g : b=4 : 5 : 1 CO 

J:3&e&fl!tv&-. ClcO^glSrfHcDti, R. G , BX' 

m&mw 4 xzm&zit. x -y ->'&aj<?>»££ rm_t 
*\ **ua, tmirmfecow&tm<Dwmm%<7>$£m 
[0045] tta. x-y ~smtiuzt$i7&&*.mL r . 

g . b j±OT<o i oiz LX-gib&z t tfx* h . nx-i& 

r : g : b = 3 : 6 : 1 
r : g : b = 4 : 5 : 1 
r : g : b = 2 : 7 : 1 . 

iiT, mL<T>itr : g : b t LX1&& U-HK>KH& 

a^-TSh-rixtf. r+g + b=l 0. OT'bSr l. 0 

fcLfcfc&fc:. gcTHitLT. 

g=5. 0—7. 0 

<7)ffiffi<9ffi#*#i Uv fe*f U r =. 1 0 . 0-b-g 
Xhh, ■ 

[0046] Ktriz. x y ^aiis (xtrrio 
6) nmmmiiz±&*v*jmiiz^xmit&. x 

cr(x.y)={-4 Z I 'Mx 
1 nl i=1 j=1 • 



I AV (x.y) (16) 

coli. tiy-W&T-f&ffifSL-t&RWfSif-fbGW 

mr-rt Bwm : -9xim<r>+(:\^;4Xi:W&-Zik 

-tick*** S(17) fc^Lfct dtc, Eiftf- 
?I 0 (x.y)<DR. G. B03feOiaSffiD R . D G . D 
B fc**««r. g. b£gKtX««if&£Wsual dens 
ity)D v {C^tS. 

D B ) / ( r + g + b) (17) 

mz^xit. mtewmLKtzizmzn 
frm%mmjgftmztt&^&t^oM.7fi>f>&i> i ) . 

\,^t^o^ziz&^xmm%mizm&.i-&<r>fiWit l 
^. ^izi±. mmffimmmizm^xmmmem* 

■ r*««J6«)JStv««JHBfe) . -B*«lt¥*lt. 5 7 
(6) , 4 1 5 ( 1 9 9 4 ) #*i>9.. fetioTMS 
TfB<Oit^3av^ffi#^ixTV^) . 

(18) 

fc* U9) srffl^T. -eo&attco^w^a^ws 
T-^i»^m^S5ctfi&«i»^aa^(x,y) icff-m-rs 
citciot; a^o^ftcx y^-^itj^^rd. a 
# £ ( n g X n K ) fct, taajft^is i.zm% 
MM&%m.LxmM.&#>miii^i> s . m«3x3. #> 

[0047] 

m2] 



"2 T .v+J-.y-y) 

», 1/2 



-<Dv(x.y)>] } (19) 



fc*£U aSBS&SSrx . y i:U D„ (x+i-ng /2 - 
1/2. y+j-n E /2-1/2) li«f9r##x-<r (x,y) irwrnt^n 
t Xn E cOB^ffi^domST'. < D v (x.y) > ti-e^s 



[S3] 



1 nE 
<Dy(x.y)>=- ! T Z 



nE 

z 



IE i=1j=1 



Dv(x*i-^-4- 



.y + j-y -y> (20) 



M<Ox.y->'^®Eo (x.y) ^«i6Stcti. TfS^ (2 



[0 048] wmi&T—? I 0 (x, y)*>4»,±ia^ 
( 1 9 ) t*L^W^-iicT(x,y)i&ti-ff L. S^f^B 

E 0 (x.y) =1- exp (-tf(x.y) /a E ) (21) 
^'L, a E (t^m^Sto(x.y) <7)m£^-yiS%>miZ$l; *)W7&mmttf&0 (x.y ) <^@gfficr T 

m-rsEgosygrefco-c. i7^ise 0 =o. 5 tcsi 

a E =-Oj / log. (0.5) (22). 
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[004 9] x-yi^JgE,, (x;y) £:£i6&33&3Si: L 
(cJ(x.y))* /a BI * > (23). 

(x, y ) wstjff! t-rst. 



(2 5 6Pgp) 10~100OKi 

E 0 (x.y) = 1 — exp { — 
fcrtfUa E ,{±<y(x.y) *^E 0 (x.y) (C»t&|g!<?) 
E 0 (x,y) =0. 5t,zm*)ttVZ>mm-fti8.o 

a E1 2 =-a T l 0ge (0.5) (24). 
X-hh . Oj Offiti. #fe8 bit (25 6Pgp> 0# (i. \3T1&*&& (25) ^J:o (c. ft*</)J§j3r#Six 
7-BtfcT'l2. 10-100 O&Boffi***?* U^. <7„ ai T'iE«'fL$ ix, 0 fcJLh l&.TV>JEMikZtvfiz 

[00 50] ifc. ^^X-yS^S^-^Eo (x.y) x 7 ^t«f-^E, (x.y) "fcWT'fc J:V\ 

(25) 

(x.yJ^TfCxS (26) coXo^&^m^Hb 



E 0 (x.y) .= cr(x,y) /cr Bai 



(J,,, (i, ^HJf^Uc-r-^ <? (x,y)^fe*cffi 
T\ <? (x,y)5rjE«^-r5?t:>6<7)^T'*)€». <r> 
®&am,i. & ( 19) T^a^M^flcco^WtfifcT 

<r Nai =M a x { cr (x.y) } 
[0 0 5 1.] ifc; a«^#^***«3fctt*»«-v 
Bdo-SB-JK W;clfB<&^^^flc<*>,fcSiI?£ 
OS^B(&<04>*Sfrfr<0=lf S£$effl, £> & v Mi£B&*» 4. 
S^IV^B^-^ (JIB«-r— *<01/4-> 1/1 0 . 
S£) *^±ie5e ( 2 5 ) ^> ( 2 6 ) £fflivtfi±ffi<7 

Lx^yiBd-r- * tttcwav mmm&x'm 
ztcoT'$&&wiimg&mmmimigiT-? crux 

^frylftf-?) *U§vvtfcJ:v>U HCB&x-*** 

^ft^aiLTtJ:^. «fco»*L<«; mm 

fl-ftT-^tf (x,y)^^v>ffi*^JH#{cM^I^<7)Ji 

(25~io xfiw.(c***t* mvwmm , mtf ±(i 1 

0 %am (C-g-i ft & <I<D^<i< (x , y) >„ ax j o , £ a 
„„ £U cj (x,y)*5ClC0cy Hai "T^-T 

«y H a, «s*au*. ^m±. wm±fo<r> 

W B (x.y) =l-cr E + a E . E 0 
W G (x.y) =1-W E (x.y) 
[ 0 0 5 5 ] d i T\ a E <ix -y S^igfc y-f X^igO 
**tttt£t£5£-r &£SSt;C*> 0 ... *^ls-?1>< 0 fcLL 1 
WT^fiES^OSrlft^-r S £ 6 . x -y v'ffll^O 

S^ft^S:w E , (x.y) i - a E tLh l MTomt 
=5:0. W E (x.y) #*£vM5i:\ *<DWm&MX'&^#; 
OX.yS^$T-fc&i»^^£¥<IBfi$*u W E (x.y) 



(26) 

THL TK^ 2m*s<.U—7tfh& Mil «y i/'tt 
ai^l/-^fcLT. Rrewittco^lx— ^ s Sobel<7) 
X^ls-^f RobertsO^^-^^i:'***)*. Rober 

g(i.j)= {(f(i.j) - f(i+l.j+l)) 2 +(f(i+l.j) - f(i. 
J*1>J*> 

t>7\s— hM^is— ft IX. 8^rr&i^x.y i/jsf 

— Vfc:fiSt2.3X3f> / 7l'- h&ffl^2> Robinson 
<7)*^\s-?^ YArsh<7>*'<.\s-?i?h&. &(C. 

^izmtf&h. Z<r>m&. m%ZWLXL$.o<7) 

x\ ftmMftim<n&fr L*mz lx *^x -y 

[0053) 14 (e) Wi. 04 ( a ) (Z^lgB^ 
*r—9 I 0 *^x>y ^ajXST-^^>^x-y^JS 
X— ^E 0 cr)^®5:^LTV>i,. 04 (a)C*tx 7 
>^jSx-^E 0 (ctJV^T. ^E, iJilXE 2 <0ft3fi 
T-x -y i^Jffix-^ E 0 crym^ <&-oXV^&Zb* { 

(0054] mz\ y a x^dgmff itflSR^mm 

7/1 0 6 ) 'Ti#4>^l>x-y>^Jg7 r -^Eo (x.y) £ 
fflut. TIE^ (2 7)-.fc:fl!oT.-Jl«y2^B«tfS)fi*ft 

m^stw E (x.y) ^*rt/if^. y>rx«jgofi^(t^ 

StW G (x.y) Sr. (28) iZ^X^h. 

(x.y) (27) 

(28) 

v t\ ■tcDwm&m.x'S a xffl&x-h&vmtf 

HS^tWMZtiZ. IE«<fc£*lX*X-y>-'§&£T-?E 0 
(x.y) com^l . CHZiSi^viSmmX'lZ. a E OffitC 
frfi-t>h-r^ -y S^lSOfi^#<t«SW E (x,y) W 1 . 
0 (Cjgi, v*; # l, MI i: ^ 0 . J A XfRtftofffcfttttfiRW 
g (x.y) Ji© *>/h$ < ^ ^ . , iBl-ft? fL^x -y i> 
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SSf-^E, (x,y) 0£*)'bZ<%Z>lzmtl. 

x y iSffl$L<7imx-mmm/ s (x, y) - a&^m i - « E 
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(57) Abstract 

Technical problem Unpleasant unevenness, unnatural artifact, etc. by the noise are not 
produced, a noise is controlled, and the image-processing approach for noise control of the 
digital image which emphasizes sharpness, equipment, and a record medium are offered a 
technical problem. 

Means for Solution Sharpness emphasis, smoothing, and edge detection are performed to 
subject-copy image data. It asks for the mixture image data of the edge of a photographic 
subject, and a noise from the obtained sharpness emphasis image data and smoothing image 
data. The weighting multiplier of a noise is obtained from the edge data on the strength for 
which it asked by edge detection. It asks for noise data from this weighting multiplier and said 
mixture image data. On the other hand Set up the noise control distribution function showing 
the breadth of noise control, perform the convolution integral of this function and the above- 
mentioned noise data, and noise control distribution is computed. Said technical problem is 
solved by hanging the above-mentioned noise data on this noise control distribution, asking for 
a noise control component, carrying out variable power of this component, subtracting from 
sharpness emphasis image data, and obtaining processing image data. 



COaiirini(s) 

COaom 1 Perform sharpness emphasis processing to subject-copy image data, and the 
sharpness emphasis image data which made sharp the noise contained in this image with an 
image is created. Perform data smoothing to said subject-copy image data, create smoothing 
image data, and said smoothing image data is subtracted from said sharpness emphasis image 
data. The mixture image data in which the noise by which sharpness emphatsis was carried but 
with the edge of the photographic subject image by which sharpness emphasis was carried out 
is intermingled is created. It asks for the edge data on the strength for performing edge 
detection from said subject-copy image data, and identifying a photographic subject edge field 
and a noise field. It asks for the weighting multiplier of the noise field which shows the degree 
of a noise field from this edge data on the strength; Multiply said mixture image data by the 
weighting multiplier of said noise field, and it is asked for noise data. The noise control 
distribution function showing the breadth of the noise control in said subject-copy image data is 
set up. By performing the convolution integral of said noise data and this noise control 
distribution function, searching for noise control distribution, and carrying out the multiplication 
of said noise control distribution to said noise data By computing noise control component 
image data, carrying out variable power of said noise control component image data, arid 
subtracting it from said sharpness emphasis image data The image-processing approach for 
noise control of the digital image characterized by creating the image which controlled 
selectively the noise component in the noise field of a subject-copy image. 

Claim 2 Said noise control distribution function is the image-processing approach according to 
claim 1 which is the monotonically decreasing function to which a value becomes small as a 
value is max and separates from this center position in the center position of the breadth of the 
noise control in the pixel of a subject-copy image. 

Claim 3 Said noise control distribution function is the image-processing approach according to 
claim 1 which is the boxcar function which has a fixed value in the range which does the noise 
control in the pixel of a subject-copy image. 

COaim 4 The range which does said noise control in the pixel of a subject-copy image of said 
noise control distribution function is the image-processing approach according to claim 2 or 3 
which is the field of or more 1 15 or less range in the number of pixels. 

Claim 5 Said noise control distribution function is the image-processing approach according to 
claim 2 to 4 set up by defining the value in the bordering location and this bordering location of 
the range which does the noise control in the pixel of a subject-copy image. 
Claim 6 Said noise control distribution function is the image-processing approach according to 
claim 5 which is function s (r) expressed with either of following type (1) - (3) when considering 
as the distance from the center position of the breadth of noise control in / for r / the pixel off 
a subject-copy image , and the control range constant which appoints the range of the 
breadth of noise control in / for a / the pixel of a subject-copy image . 
s(r)= exp(-r/a) (1) 
s(r)= exp(-r2 /a2 ) (2) 
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s(r) = rect(r/a) (3) 

Here, the value of rect (r/a) of a formula (3) is the boxcar function of 1. 
Claim 7 The sharpness emphasis processing section which creates the sharpness emphasis 
image data which made sharp the noise which performs sharpness emphasis processing to 
subject-copy image data, and is contained in this image with an image, The data-smoothing 
section which performs data smoothing to said subject-copy image data, and creates smoothing 
image data, Said smoothing image data created in said data-smoothing section is subtracted 
from said sharpness emphasis image data. The edge noise mixture component extract section 
which creates the mixture image data in which the noise by which sharpness emphasis was 
carried out with the edge of the photographic subject image by which sharpness emphasis was 
carried out is intermingled, The edge detecting element which asks for the edge data on the 
strength for performing edge detection from said subject-copy image data, and identifying a 
photographic subject edge field and a noise field, The noise field weighting-factor operation part 
which asks for the weighting multiplier of the noise field which shows the degree of a noise field 
from the edge data on the strength for which it asked by this edge detecting element, The noise 
component discernment separation section which multiplies said mixture image data created in 
said edge noise mixture component extract section by the weighting multiplier of said noise 
field for which it asked by said noise field wejghting-factor operation part, and asks it for noise 
data, The noise control distribution function setting-out section which sets up the noise control 
distribution function showing the breadth of the noise control in said subject-copy image data, 
The noise control distribution operation part which performs the convolution integral of said 
noise data for which it asked in said -noise component discernment separation section, and said 
noise control distribution function set tip in said noise control distribution function setting-out 
section, and searches for noise control distribution, By carrying out the multiplication of said 
noise control distribution searched. for in this noise control distribution operation part to said 
noise data for which it asked in said noise component discernment separation section The noise 
control component operation part which computes noise control component image data, The 
image processing system for noise control of the digital image characterized by having the 
noise control data-processing section which carries out variable power of said noise control 
component image data computed by said noise control component operation part, subtracts it 
from said sharpness emphasis image data, and asks for processing image data. 
Claim 8 The procedure which creates the sharpness emphasis image data which made sharp 
the noise whjch performs sharpness emphasis processing to subject-copy image data, and is 
contained in this image with an image, The procedure which performs data smoothing to said 
subject-copy image data, and creates smoothing image data, Said smoothing image data is 
subtracted from said sharpness emphasis image data. The procedure which creates the mixture 
image data in which the noise by which sharpness emphasis was carried out with the edge of 
the photographic subject image by which sharpness emphasis was carried out is intermingled, 
The procedure of asking for the edge data on the strength for performing edge detection from 
said subject-copy image data, and identifying a photographic subject edge field and a noise 
field, The procedure of asking for the weighting multiplier of the noise field which shows the 
degree of a noise field from said edge data on the strength, The procedure of multiplying said 
mixture image data by the weighting multiplier of said noise field, and asking it for noise data, 
The procedure of setting up the noise control distribution function showing the breadth of the 
noise control in said subject-copy image data, performing the convolution integral of said noise 
data and this noise control distribution function, and searching for noise control distribution, 
The procedure which computes noise control component image data by carrying out the 
multiplication of said noise control distribution to said noise data, A computer is made to 
perform the procedure which carries out variable power of said noise control component image 
data, and subtracts it from said sharpness emphasis image data. The record medium which the 
computer which recorded the program characterized by creating the image which controlled 
selectively the noise component in the noise field of a subject-copy image can read. 



Detailed Description of the Invention 
0001 

Field of the Invention This invention relates to the image-processing approach, the 
equipment, and the record medium of the digital image which controls noise (noise) 
components including granular ** of a digital image, and carries out sharpness emphasis. 
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0002 

Description of the Prior Art The Image processing of the digital image in which the image of 
a film photo was scanned and mentioned with the image input scanner, and the digital image 
photoed by the digital still camera etc. is carried out, and in a system which is outputted by the 
image output printer, the outputted image has large sharpness degradation by the scanner, the 
camera, and the printer, and in order to recover it, sharpness emphasis by the Laplacian filter 
or the unsharp mask (USM) is performed from the former. However, since the side effect that 
noises (noise), such as the shape of a grain, get worse occurred while the sharpness of an 
image improves, it was difficult to be able to perform only moderate sharpness emphasis within 
limits by which granular aggravation is permitted in an image with noises, such as. the shape of 
a grain, but. to raise image quality more than a manuscript image. 

0003 There are troubles — although some are proposed as the image-processing method for 
removing the shape of a grain used as a noise in a digital image, and emphasizing sharpness, 
equalize as an approach of removing the shape of a grain, or since the approach of obscuring is 
used, the granular pattern which faded is visually sensed unpleasant, or minute photographic 
subject structure is erased unnaturally — and it is not suitable for an aesthetic image like a 
photograph. 

0004 In images, such as a photograph, printing, television, and various copying machines, in 
order to recover the noise (noise) and sharpness degradation which are added in case 
manuscript images, such as the shape of a grain of a proper, sharpness degradation or a 
photograph, and printing, are digitized by the picture input device to sharpness degradation by 
the optical system of a camera etc., and photosensitive material, a noise is controlled or various 
approaches are devised as the image-processing method for emphasizing sharpness. For 
example, by the conventional image-processing approach, the approach of smoothing or coring ' 
is used as a granular clearance art, and processing by the unsharp mask (USM;Unsharp 
Masking), or Laplacian or a high-pass filter is used as a sharpness emphasis approach. 
However, in these conventional granular clearance arts, Artie FAKUTO which has unnatural 
sense of incongruity when the shape of a grain is controlled arose, and it had the fault of both 
controlling the fine structure of the image which must not be controlled originally, as it is 
granular which is not desirable. 

0005 For example, a ****** No. 500311 57 to official report, a 57-500354 official report, and 
the "digital emphasis approach of a photograph that the shape of a grain is conspicuous in Anh 
Sharp", The electronic image-processing international minutes, July, 1982, The 179-183rd page 
(P.) G.PoweM and B.E.Bayer and "A Method for the Digital Enhancement of Unsharp, Grainy 
Photographic Images", and Proceedingus of the International Conference onElectronic Image 
Processing and Jul. 26- in the approach of 28, 1982, POWERU indicated by pp.179-183, and 
buyers The approach by the unsharp mask (high-pass filter) is used as the sharpness emphasis 
approach, using a data-smoothing method (low pass filter) as the granular control approach. By 
multiplying the signal value of a nxn pixel by weighting, such as a Gaussian mold, and 
graduating a signal, data smoothing is processing which controls the shape of a grain. 
Sharpness emphasis processing calculates the differential value of the direction of a main pixel 
to a perimeter pixel using the picture signal of a mxm pixel first, and when smaller than the 
threshold which the value set up, it is regarded as the shape of a grain, or a noise, and the sum 
of a larger differential value than the threshold which removed and remained by coring 
processing is taken, and sharpness emphasis is performed by multiplying by 1.0 or more 
constants and adding to the above-mentioned smoothing signal. 

0006 In this approach, in order for the large unevenness pattern which consists of a big cluster 
(granular mottle) of the particle which constitutes the shape of a grain to be visually 
conspicuous although the shade contrast of a granular pattern falls since the granular pattern is 
obscured, there is an unpleasant fault that it is visible as granular. Moreover, by that which is 
identifying the image with the set-up threshold as it is granular (coring processing), granular 
misconception of the low picture signal of contrast is carried out, it will be controlled removed 
with the shape of a grain, or discontinuity arises on a boundary with the picture signal 
emphasized as the removed signal, and there is a fault that an unnatural artifact is looked at by 
the image. This fault appears in the image with which textures, such as detailed images, such 
as grass and a carpet, and cloth, are described especially, and it becomes the artifact which is 
not visual very unnatural and desirable. 

0007 

ProbBeinni(s) tto be Solved by tthe lowerofcoomi by the way, by the conventional granular control 
and sharpness emphasis image-processing approach mentioned above Emphasize sharpness by 
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the unsharp mask and a granular (noise) signal and a profile signal are separated from a 
subject-copy image with signal level using the technique which obscures the shape of a grain or 
is controlled by smoothing. Since it considers that a small signal is granular and it is processed 
by a profile signaPs carrying out sharpness emphasis and carrying out granular control of the 
smooth field Picture signals, such as a texture of grain-like signal level and a near image details 
signal, i.e., clothing, and the hair, were both controlled as it is granular, and there was a 
problem that there was a fault which serves as an unpleasant image visually as an artifact of an 
image processing. Namely> although the granular. pattern ("granular fade and ") which has . 
obscured the image, using equalization as the approach of granular control, and faded appears 
in such a conventional method as if it became small as fluctuation of the concentration in an 
image and the shape of a grain became good Conversely, although the amount of concentration 
fluctuation was small, the granular pattern which faded and spread has been visually recognized 
to be an unpleasant pattern, and it had the problem that it was conspicuous especially with 
uniform photographic subjects, such as faces and the skins, such as a portrait-photograph, or a 
wall, and empty. 

0008 moreover, in the conventional method which separates a granular (noise, noise) field and 
a profile field from a subject-copy image with signal level By fading with a subject-copy image, , 
discriminating a profile field and a flat field from the differential signal of an image, and 
processing using a multiplier which is. LapDacian / aim. unsharp mask, different to each field 
Although granular control was carried out in the profile field in the flat field, without having 
emphasized sharpness and obscuring an edge, controlling the shape, of a grain, since 
recognition and separation of a profile field and a granular field were uniformly performed with 
the signal level used as a threshold, there was a problem that discontinuity arose on the 
boundary. Furthermore, in such a conventional method, although an unsharp mask and 
Laplacian were used as edge enhancement or the sharpness emphasis approach, it was easy to 
generate a burster trimmer stacker feature like the Mackie line in the profile and the edge 
section of an image, and there was a problem of giving an unnatural impression visually. The 
problem about control and sharpness emphasis of the shape of such a grain etc. of a noise is 
generated as control of various noises including a shot noise or an electric noise, and a problem 
of sharpness emphasis> also in case an image is photoed not by the problem peculiar to a film 
photo but by a digital still camera etc. 

0009 This invention is made in view of the actual condition of the above-mentioned 
conventional technique, and is set in images, such as a film photo, a digital still camera image, 
printing, television, and various copying machines. It is based on a camera and fades. In 
manuscript images, such as, the shape of a grain of. photosensitive material, and dotage, the 
noise (noise) of a proper, and sharpness degradation, Or in case processing which recovers the 
shot noise at the time of taking a photograph by the noise and digital still camera which are 
added in. case the manuscript image is digitized by the picture input device, and sharpness 
degradation is performed The trouble that a noise fades and large unevenness looks unpleasant 
visually if the trouble of the above-mentioned conventional technique, i.e., the noise by 
smoothing, is controlled, The trouble that the low picture signal of contrast is taken for a grain 
or a noise, and is controlled or removed, The ** which does not produce the trouble that the 
boundary of a noise rejection field and a sharpness emphasis field becomes discontinuous, and 
an unnatural artifact is looked at by the image, A noise is controlled and it aims at offering the 
record medium which the computer which enforces the image processing system which carries 
out the image-processing approach of a digital image and this which perform sharpness 
emphasis of an image, and this approach can read. 

0010 

Means for SoBving the Probfleirn In order to attain the above-mentioned object, this invention 
performs sharpness emphasis processing to subject-copy image data. The sharpness emphasis 
image data which made sharp the noise contained in this image with an image is created. 
Perform data smoothing to said subject-copy image data, create smoothing image data, and 
said smoothing image data is subtracted from said sharpness emphasis image data. The 
mixture image data in which the noise by which sharpness emphasis was carried out with the 
edge of the photographic subject image by which sharpness emphasis was carried out is 
intermingled is created. It asks for the edge data on the strength for performing edge detection 
from said subject-copy image data, and identifying a photographic subject edge field and a 
noise field. It asks for the weighting multiplier of the noise field which shows the degree of a 
noise field from this edge data on the strength. Multiply said mixture image data by the 
weighting multiplier of said noise field, and it is asked, for noise data. The noise control 
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distribution function showing the breadth of the noise control in said subject-copy image data is 
set up. By performing the convolution integral of said noise data and this noise control 
distribution function, searching for noise control distribution, and carrying out the multiplication 
of said noise control distribution to said noise data By computing noise control component 
image data, carrying out variable power of said noise control component image data, and 
subtracting it from said sharpness emphasis image data The image-processing approach for 
noise control of the digital image characterized by creating the image which controlled 
selectively the noise component in the noise field of a subject-copy image is offered. 

0011 It is desirable that it is the monotohically decreasing function to which a value becomes 
small as a value is max and separates from this center position in the center position of the 
breadth of noise control an / here / "in saodl noise control distribution- function / the pixel! 
off a subject-copy image , or as for said noise control distribution function, it is desirable that 
it is the boxcar function which has a fixed value in the range which does the noise control in the 
pixel of a subject-copy image. 

0012 Moreover, as for the range which does said noise control in the pixel of a subject-copy 
image of said noise control distribution function, it is desirable that it is the field of or more 1 15 
or less range in the number of pixels, and it is said noise control distribution function 
desirable to be set up by defining the value in the bordering location and this bordering location 
of the range which does the noise control in the pixel of a subject-copy image. 

0013 When making it into the distance from the center position of the breadth of noise control 
in / Ifor r / the pixel off a subject-copy image , and the control range constant which" " 
appoints the range of the breadth of noise control in '/'for a / the poxeD off a subject-copy 
image , as for said noise control distribution function, it is desirable that it is function s (r) 
expressed with the following formula (1). s (r) = exp (-r/a) (1) 

s(r)= exp(-r2 /a2 ) (2) 
s(r)= rect(r/a) (3) 

Here, the value of rect (r/a) of a formula (3) is the boxcar function of 1. 

0014 In order to attain the! above-mentioned object, furthermore, this invention The sharpness 
emphasis processing section which creates the sharpness emphasis image data which made 
sharp the noise which performs sharpness emphasis processing to subject-copy image data, 
and is contained in this image with an image, The data-smoothing section which performs data 
smoothing to said subject-copy image data, and creates smoothing image data, Said smoothing 
image data created in said data-smoothing section is subtracted from said sharpness emphasis 
image data. The edge noise mixture component extract section which creates the mixture 
image data in which the noise by which isharpness emphasis was carried out with the edge of 
the photographic subject image by which sharpness emphasis was carried out is intermingled, ~ 
The edge detecting element which asks for the edge data on the strength for performing edge 
detection from said subject-copy image data, and identifying a photographic subject edge field 
and a noise field, The noise field weighting-factor operation part which asks for the weighting 
multiplier of the noise field which shows the degree of a noise field from the edge data on the 
strength for which it asked by this edge detecting element, The noise component discernment 
separation section which multiplies said mixture image data created in said edge noise mixture 
component extract section by the weighting multiplier of said noise field for which it asked by 
said noise field weighting-factor operation part, and asks it for noise data, The noise control 
distribution function setting-out section which sets up the noise control distribution function 
showing the breadth of the noise control in said subject-copy image data, The noise control 
distribution operation part which performs the convolution integral of said noise data for which 
it asked in said noise component discernment separation section, and said noise control 
distribution function set up in said noise control distribution function setting-out section, and 
searches for noise control distribution, By carrying out the multiplication of said noise control 
distribution searched for in this noise control distribution operation part to said noise data for 
which it asked in said noise component discernment separation section The noise control 
component operation part which computes noise control component image data, Variable power 
of said noise control component image data computed by said noise control component 
operation part from said sharpness emphasis image data is carried out. The image processing 
system for noise control of the digital image characterized by having the noise control data- 
processing section which subtracts and asks for processing image data is offered. 

0015 In order to attain the above-mentioned object, moreover, this invention The procedure 
which creates the sharpness emphasis image data which made sharp the noise which performs 
sharpness emphasis processing to subject-copy image data, and is contained in this image with 
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an image, The procedure which performs data smoothing to said subject-copy . image data, and 
creates smoothing image data, Said smoothing image data is subtracted from said sharpness 
emphasis image data. The procedure which creates the mixture, image data in which.the noise 
by which sharpness emphasis was carried out with the edge of the photographic subject image, 
by which sharpness emphasis was carried out is intermingled, The procedure of asking for the 
edge data on the strength for performing edge detection from said subject-copy image data, 
and identifying a photographic subject edge field and a noise field, The procedure of asking for 
the weighting multiplier of the noise field which shows the degree of a noise field from said 
edge data on the strength, The procedure of multiplying said mixture image data by the 
weighting multiplier of said noise field, and asking it for noise data, The procedure of setting up 
the noise control distribution function showing the breadth of the noise control in said subject- 
copy image data, performing the convolution integral of said noise data and this noise control 
distribution function, and searching for noise control distribution, The procedure which 
computes noise control component image data by carrying out the multiplication of said noise 
control distribution to said noise data, A computer is made to perform the procedure which . 
carries out variable power of said noise control component image data, and subtracts it from 
said sharpness emphasis image data. The record medium vyhich the computer which recorded 
the program characterized by creating the image which controlled selectively the noise 
component in the noise field of a subject-copy image can read is offered. 

0016 The noise contained in the image data obtained using an image sensor and the various 
camera tubes, such as CCD, such as a digital still: camera, and^MOS,. without using not only the 
shape of a grain resulting from the particle of sensitization material but the silver salt sensitive 
material contained in the image data which reads the photographic film using silver salt 
sensitive material etc. usjng a film scanner, and is obtained with the above-mentioned noise 
here is also included widely. 

0017 The above-mentioned invention detects an edge from - subject-copy image, ask for edge 
reinforcement/ and rt is considered that the field where edge reinforcement is weak is a noise 
field. By computing the weighting multiplier of the noise field for dividing a noise field from an 
edge field,, creating a sharpness emphasis image and a smoothing image from - subject-copy 
image, and subtracting a smoothing image from a sharpness emphasis image It asks for the 
mixture component of the noise by which sharpness emphasis was carried out with the edge by 
which sharpness emphasis was carried out. - From the noise component which carried out the 
multiplication of the weighting multiplier of a noise field to the edge and the mixture component 
of a noise, and asked for it By searching for noise control distribution using; a noise control 
distribution function, asking for a noise control component from this noise control distribution 
and the above-mentioned noise component, and subtracting a noise control component from - 
sharpness emphasis image For example, when subject-copy image data are read in the 
photographic film using silver salt sensitive material etc. using a film scanner, It is the big 
cluster of the particle of sensitive material, and in a part with the larger (the shape of a grain is 
coarse) granular mottle which forms a noise component, the shape of a grain is controlled 
strongly, and by the part with small granular mottle, the shape of a grain is controlled weakly 
or it controls. By this, fluctuation of the noise of granular ** can be controlled, it can equalize, 
and the good image of image quality with which parts which swing greatly spatially, such as 
granular mottle, were selectively controlled in the noise field of an image can be obtained. 
When subject-copy image data were photoed using image sensors, such as a digital still 
camera, and are obtained, Although various noises, such as a noise of the proper of the one- 
piece one photosensor in photon fluctuation and the image sensor of incident light or thermal 
noise (noise) generated in an electrical circuit, and a quantization noise> serve as a signal of a 
pixel unit, or concentration fluctuation and appear in an image Since the part and the dense 
part of a non-dense arise and form noise mottle as well as the granular mottle of silver salt 
sensitive material spatially, noise fluctuation By controlling the large place of noise mottle 
strongly, by controlling weakly, the small place of noise mottle can equalize a noise and can 
obtain the good image of image quality. 

0018 That is, by the image-processing approach of noise control of this invention, processing 
which makes fluctuation of the image concentration by the noise homogeneity small (dispersion 
in the magnitude of fluctuation is made small) is performed whether a noise component is 
identified, a coarse large noise is more strongly controlled like the noise mottle in the noise 
component, and the small thing of a noise is controlled weakly, and by performing processing 
which is not controlled, as obtain / since data smoothing is not performed for a granular 
pattern like before, it is not conspicuous and big granular mottle is carried out, when 
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a noise component is a granular component / when a fine grain emulsion is used with 
a film photo sensitized material— fine — being granular (it being fine, and the amplitude 
being also small, and spatially, granular) — it can carry out. 
0019 

Embodiment of the Invention Hereafter, the image processing system which enforces the 
image-processing approach of this invention is explained to a detail based on the suitable 
example shown in an attached drawing. The "noise" in this invention points out a noise at large, 
as mentioned above. Moreover, although a "noise" only calls it a noise by electronic image pick- 
up systems, such as a digital still camera, it is common to say that it is granular rather than a 
noise in silver salt photosensitive material. Therefore, it is subsequent explanation, and when 
explaining especially silver salt photosensitive material as an example, it changes to a "noise" 
and uses "it is granular." Moreover, the "noise mottle" mentioned later also contains the 
granular mottle in silver sajt photosensitive material besides in whocHTnoise fluctuation, 
forms a dense part spatially in electronic image pick-up systems, such as a- digital still 
camera, noise mottle. 

0020 Drawing 1 is a system incorporating the image processing system concerning this 
invention, and is the block diagram of the color picture regeneration system which reads a color 
picture, performs the image-processing approach of this invention, and outputs a color picture. 
Drawing 2 is the block diagram of one example of the image processing system which enforces 
the image-processing approach concerning this invention. Drawing 3 is a flow chart which 
shows ah example of the processing algorithm of the image-processing approach of this 
invention. The following explanation explains the image data obtained from a silver salt color 
photography image as a digital image as an example of representation^ 

0022. As shown in drawing 1 , the color picture regeneration system 10 The picture input device 
12 which reads color pictures, such as a color photography image (photography images, such 
as film images, such as a negative color film arid a color reversal film, etc. and a digital 
camera), and obtains digital input image data, The image processing for noise control of the 
digital image of this invention and sharpness emphasis is performed to the input image data 
inputted from a picture input device 12 with a necessary image processing. Processing image 
data II Processing image data II outputted from the image processing system 14 to obtain and 
an image processing system 14 It has the image output unit 16 which is based and outputs 
color pictures, such as a print image. 

0022 The scanner equipment for reflection copies which a picture input device 12 creates 
digital color picture data, and reads color reflection copy images, such as the film scanner 
equipment and the print which it is, for example, read color film images, such as a color (or 
monochrome) negative film and a color (or monochrome) reversal film, and create digital image 
data, a reflective print image, etc. for outputting as input image data to an image processing 
system 14, and creates digital image data is mentioned, in addition, the digital camera, 
electronic "still" camera, and video camera which radiograph a photographic subject and create 
digital image data in this invention — or The record medium which stored the digital image data 
created by these For example, semiconductor memory and FDs, such as SmartMedia, a memory 
stick, and a PC card, Magneto-optic-recording media and CD-ROMs/such as magnetic-recording 
media, such as Zip, and MO, MD, The driver which drives optical recording media, such as 
Photo-CD, etc. and is read as digital image data, The CRT monitor which reads these digital 
image data and displays a soft copy image, You may be the computers for which cairiry out 
the image processing of am indicating equipment amid the digital image data dispDayed 
or it read, such as a Diquid arystaD dispDay monitor, on the whofle or seBectiveOy / PC : 
and WS image processings etc. 

0023 The image output unit 16 is the processing image data II outputted from an image 
processing system 14 as final-treatment image data. It is for outputting the based color picture 
by which color input images, such as a color photography image, were reproduced. The digital 
photograph printer, copying machine, and electrophotography which output color hard copy 
images, such as a reflective print image and a reflection copy image, Computers displayed as 
image output units, such as a digital color printer of various methods, such as a laser beam 
printer, an ink jet, a heat sublimation mold, and TA, and a soft copy image, such as displays 
and PCs, such as TV, a CRT monitor, and a liquid crystal display monitor, and WS, can be 
mentioned. 

0024 Since it outputs by the color of the input image data from a picture input device 12, the 
color of the request of a tune (gradation) to the image output unit 16, and tone reproduction, 
an image processing system 14 carries out adjustment processing, and it is the subject-copy 
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image data IO. The color and the tune processing section 18 to create, Subject-copy image . 
data IO processed by this color and tune processing section 18 It is the part of this invention by 
which it is characterized most. The image-processing approach for noise control of the digital 
image of this invention and sharpness emphasis is enforced, and it is the processing image data 
II. The noise control and the sharpness emphasis image-processing section 20 to create, It has 
the picture monitor and the image-processing parameter setup section 22 which consists of the 
image-processing parameter setup section which sets up the parameter for performing the 
picture monitor which displays a playback image based on the image data to which a color and 
tune repeatability were adjusted and various necessary image processings, and the image 
processing of this invention. 

0025 A color and the tune processing section 18 perform color conversion or color correction 
(gray scale conversion or amendment is also included) here so that the color of the input image 
data inputted from a picture input device 12 and the repeatability of a.tune (gradation) may be 
reproduced proper in the image output unit 16. Subject-copy image data IO for enforcing the 
image-processing approach of this invention As processing which creates and is performed here 
For example, various processings of color (gray) conversion, amendment, gradation 
amendment, concentration (brightness) amendment, saturation amendment, scale-factor 
conversion, compression, expanding of a concentration dynamic range, etc., etc. can be 
mentioned. 

0026 A picture monitor and the image-processing parameter setup section 22 While displaying 
an. input image based on the input image data which consisted of a picture monitor and the: 
image-processing parameter setup section, and was inputted into the picture monitor from the 
picture input device 12 This picture monitor is used (for example, by GUI etc.). It is for setting 
up with data input machines which do not illustrate the parameter of various kinds of image: 
processings performed to input image data in the noise control image-processing section 20 for 
enforcing the image-processing approach of a color, the tune processing section 18, and this 
invention, such as a mouse and a keyboard. Here, the parameter set up can mention various • 
multipliers, constants, etc. which are needed when enforcing the image-processing approach of 
this invention explained to a detail to the correction factor used for various kinds of processings 
mentioned above, a transform coefficient, a scale factor, etc. and the back. 

0027 The noise control image-processing section (only henceforth this image-processing 
section) 20 which enforces the image-processing approach of this invention is the subject-copy 

, image data IO created in a color and the tune processing section 18. Processing image data II 
which is final-treatment image data for performing the noise control by which it is characterized 
off 1th5s Dovemitiioini , and the image processing of sharpness emphasis, and outputting to the 
image output unit 16 It is for creating. 

0028 Here, this image-processing section 20 is the subject-copy image data IO, as shown jn 
drawing 2 . Sharpness emphasis processing is performed. Sharpness emphasis image data IS 
which also made sharp noises (noise) including the shape of a grain included in this image with 
an image The sharpness emphasis processing section 24 to create, Subject-copy image data IO 
The data-smoothing section 26 which performs data smoothing and creates the smoothing 
image data IAV, subject-copy image data 10 from — the smoothing image data IAV being 
subtracted and with the edge noise mixture component extract section 28 which creates 
mixture image data deltalEG jn which the edge and noise of a photographic subject image are 
intermingled Edge data EO on the strength for performing edge detection of a photographic 
subject image from the subject-copy image data IO, and identifying a photographic subject 
edge field and a noise field The edge detecting element 30 for which it asks, this edge data EO 
on the strength from — weighting multiplier WG of a noise field With the noise field weighting- 
factor operation part 32 for which it asks Weighting multiplier WG of the noise field for which 
mixture image data deltalEG obtained in the edge noise mixture component extract section 28 
was asked by the noise weighting-factor operation part 32 It takes advantaging. Noise data GO 
of a noise field The noise component discernment separation section 34 for which it asks, 
Subject^copy image data iO Noise control distribution function si showing the breadth of noise 
control which can be set The noise control distribution function setting-out section 36 calculated 
and set up, Noise data GO for which it asked in the noise component discernment separation 
section 34 Noise control distribution function si set up in the noise control distribution function 
setting-out section 36 Perform a convolution integral and the noise mottle control distribution 
(equivalent to the noise control distribution in this invention) M is calculated.. The noise mottle 
control distribution operation part 38 for which it asks (equivalent to the noise control 
distribution operation part in this invention), Noise data GO which searched for the noise. mottle 
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control distribution M searched for by the noise mottle control distribution operation part 38 in 
the noise component discernment separation section 34 By carrying out multiplication Noise 
control component image data Gl Noise control component operation part 40 to compute, noise 
control component image data Gl computed by the noise control component operation part 40 
Sharpness emphasis image data IS which carried out variable power and was calculated in the 
sharpness emphasis processing section 24 It subtracts, from — Processing image data II 
suitable for the image output unit 16 It has the noise control data-processing section 42 to 
change. 

0029 The noise control and the sharpness emphasis image-processing section 20 shown in 
drawing 2 are constituted as mentioned above fundamentally. Next, the image-processing 
approach of this invention is outlined based on. an operation of this processing section 20, 
referring to the flow chart which shows the processing algorithm of the image-processing 
approach of this invention shown in drawing 3 . 

0030 this example is shown in drawinig 3 — as — every pixel ~ first — subject-copy image data 
IO from — Sharpness emphasis processing is performed in the sharpness emphasis processing 
section 24 (step 100). Sharpness emphasis image data IS Obtain and data smoothing is 
performed in the data-smoothing section 26 (step 102). The smoothing image data IAV is 
obtained and intermingled mixture image data deltalEG of the edge and noise which sharpness 
emphasis was carried out and were made sharp in the edge noise mixture component extract 
section 28 is extracted (step 104). 

0031 on the other hand the edge detecting element 30 — setting — subject-copy image data 
IO from — edge data EO on the strength for identifying a photographic subject edge field and a 
noise field asking— edge detection — carrying out (step 106) — the noise field weighting-factor 
operation part 32 — setting — weighting multiplier WG of a noise field It calculates and asks 
(step 108). Furthermore, in the noise component discernment separation section 34, 
discernment and separation of noise data are performed (step 110). Namely, weighting 
multiplier WG of the noise field for which mixture image data deltalEG was asked by the noise 
weighting-factor operation part 32 It takes advantaging and is the noise data GOi It asks. 

0032 Next, it sets in the noise control distribution function setting-but section 36, and is the 
subject-copy image data 10. Noise control distribution Seki si showing the breadth of noise 
control which can be set Set up and it sets to the noise mottle control distribution operation 
part 38. Noise data GO This noise control distribution function si Perform a convolution integral, 
search for the noise mottle control distribution M (step 112), and it sets to the noise control 
component operation part 40. It is the noise data GO about the noise mottle control distribution 
M. By carrying out multiplication Noise control component image data Gl Calculate arid 
compute (step 114 (it is a deed about the operation of noise mottle control distribution)), and it 
sets in the noise control data-processing section 42. sharpness emphasis image data IS 
obtained in the sharpness emphasis processing section 24 from— noise control component 
image data Gl computed previously Carry out variable power and it subtracts (it is a deed 
about the operation of a noise control image). Furthermore, it is the processing image data II 
by changing into the image data suitable for the image output unit 16 if needed. It obtains 
(step 116). 

0033 Next, each process which the image-processing approach of this invention mentioned 
above is explained to a detail. First, a sharpness emphasis process (step 100) is explained. 
Here, as an approach of emphasizing the sharpness of an image, they are an unsharp mask 
(Unsharp masking, USM) or Laplacian (Laplacian). It is known well. Also in this invention, if 
sharpness degradation of an image is slight by using these, the sharpness of an image can be 
emphasized. 

0034 An unsharp mask is the subject-copy image data 10 (x y) (the pixel location to observe) 
like a degree type, x And y ** — it carries out from — a part for the edge strong preparation 
which lengthened and asked for the images Iavx and y which equalized or obscured 10 (x y) — 
I0(x y)-Iav (x y) a multiplier a— hanging — subject-copy image data 10 (x y) By adding, like 
the following type (4) Sharpness emphasis image IS (x y) It is the approach of searching for. 
IS x, y =I0(x y)+a I0(x y)-Iav x, y (4) 

Here, a is a constant which adjusts extent of sharpness emphasis. By subtracting quadratic 
differential (Laplacian) **2 10 (x y) of the subject-copy image data 10 (x y) from the subject- 
copy image data 10 (x y), Laplacian is the approach of carrying out sharpness emphasis, and is 
expressed with a degree type. 
IS x y =I0(x y)-**2 10 (x y) (5) 

As a concrete example of the sharpness emphasis by Laplacian, a multiplier array of 3x3 like 
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the following formula (6) is used well. • - 
0-10-1 -1 -11-2 1 -1 5 -1 -1 9 -1 -2 5 -2 (6) 

0-1 0 -1-1-1 1-2 1 0035 In this multiplier array, when strong sharpness emphasis is hung 
especially, it is easy to generate an unnatural profile on the edge of an image. Then, in order to 
lessen such a fault, it is desirable to. use the unsharp mask using the dotage function of a 
normal-distribution mold (Gaussian) as shown in the formula (7) by this invention. 
G(x y) =(l/2pisigma2) exp - (x2+y2) / 2sigma2 (7) 

Here, it is sigma2. It is a parameter showing the breadth of a normal distribution function, and 
is edge x=xl of a mask. Ratio of the value which can be set, and the value in the core x= 0 of a 
mask G(l xO)/G(0 0) =exp -xl2 / 2sigma2 (8) 

By adjusting so that it may become ** 0.1-1.0, it can consider as the thing of a request of the 
sharpness of the unsharp mask of 3x3. If the value of a formula (8) is made into the value near 
1.0, the almost same mask as the Laplacian filter of the center of a formula (5) can be made. 
In order to change the sharpness of a mask, the spatial frequency of the image by which 
sharpness emphasis was carried out can be substantially changed by there being a method of 
changing the magnitude of a mask, for example, using the mask of 5x5, 7x7, and 9x9 grade. 
0036 Moreover, the mask of an exponential model like things other than the above-mentioned 
normal-distribution mold, for example, the following type, (9) also as a function. form of a mask 
can be used. 

E(x,y)=exp-(x2 + y2)l/2/a (9) 

Here, a is sigma2 of a formula (8). It is the parameter with which the breadth of an unsharp 
mask is expressed similarly, and is the ratio of the value of the edge of a mask, and the central 
value of a mask. E(l x0.)/E(0 0) =exp -xl/a (10) 

By adjusting so that it may become 0.1-1.0, it can consider as the thing of a request of the 
sharpness of the unsharp mask of 3x3. The numerical example of the mask of the exponential^ 
function of the formula (9) when being referred to as E (1 xO) / E(0 0) = 0.3 is shown in a 
formula (10). 

0,18 0.30 0.18 0.30 1.00 0,30 (11) ; 

0.18 0.30 0.18 — if one example of an unsharp mask is calculated from this mask, it will 

become like a degree type (12). 

-0.12 -0.22 -0.12 -0.21 2.32 -0.21 (12) 

- 0.12 -0.21 -0.12 0037 Sharpness emphasis image data IS (x y) can be calculated from the 
subject-copy image data 10 (x y) using such an unsharp mask. In addition, the unsharp mask 
and the sharpness emphasis approach which are used for this invention are not necessarily 
limited to what was mentioned above, and it is needless to say for the: sharpness emphasis 
approach by other conventionally well-known unsharp masks, spatial frequency filtering, etc. to 
be applied, field El where an edge component is dominant in drawing 4 (a) And field E2 
Subject-copy image data 10 which have a noise field including Field A and Field B with noise 
mottle, and Field C By showing an example of a single dimension profile wave and giving 
sharpness emphasis to this profile wave As shown in drawing 4 (b), it is a field El. And field E2 
While the signal of an edge is emphasized in the field where an edge component is strong like, 
it turns out that a noise component is emphasized also about a noise field including Field A, 
Field B, and Field C. 

0038 Next, a smooth chemically-modified degree (step 102) is explained. As an approach of 
graduating, processing of a real space field and processing of a spatial-frequency field can be 
mentioned. In real space field processing, there are various approaches, such as the approach 
of calculating the average in quest of the sum of the adjoining whole pixel, and transposing to 
the value, a method of multiplying each pixel by the weighting factor, for example, the function 
of a normal-distribution mold, and calculating the average, and a method of performing un- 
****** processing like a median filter. On the other hand, in processing of a spatial-frequency 
field, there is a method of hanging a low pass filter. For example, the following ceremony (13) 
can be held by the approach of equalization using a weighting factor, in addition, here (x y)> 
etc. — the position coordinate of the attention pixel in an image is expressed. 
Equation 1 

.[x] ID=000003 



0039 However, n is the mask size of equalization, and w (x y). It is a weighting factor. It will 
become an arithmetic average if w (x y) = 1.0. Although the approach of applying the 
weighting factor of a normal-distribution mold and calculating the average in real space field 



file://C:\pdf\MTJP200 1 28564 1 .htm 



2005-11-10 



PatentOrder MT 



Side 12 af 20 



processing is used in this invention, it is not limited to this. At this time, it is desirable as a 
mask of processing to use the mask of the following nxn pixels. It is desirable to specifically use 
3x3 to 5x5, 7x7, and about 9x9 thing. 

wll w!2 wl3 (14) ..... wlnw 21w22w23 ..... w2nw 31w32w33 w3n- 

wnl wn2 wh3 ..... wnn 0040 An example of a 9x9-pixel mask is shown. Although the 

value normalized to 1.0 shows the main value by this formula (15), it is made for the sum of 
the whole mask to be set to 1.0 in actual processing. 

0.09 0.15 0.22 0.28 0.30 0.28 0.22 0.15 0.09 0.15 0;26 0,38 0.47 0.51 0.47 0.38 0.26 0.15 
0.22 0.38 0.55 0.69 0.74 0.69 0.55 0.38 0.22 0.28 0.47 0.69 0.86 0.93 0.86 0169 0.47 0.28 
0.30 0.51 0.74 0.93 1.00 0.93 0.74 0.51 0.30 (15) 

0.28 0.47 0.38 0.47 0.51 0.47 0.38 0.26 0.15 0.09 0.15 0.22 0.28 0.30 Q.28 0.22 0.15 0.09 

0041 0.69 0.86 0.93 0.86 0.69 0.47 0.28 0.22 0.38 0.55 0.69 0.74 0.69 0.55 0.38 0.22 0.15 
0.26 It can ask for the smoothing image data IAV (x y) from the subjeet-copy image data 10 (x 
y) using such a mask. In addition, as the smoothing approach used for this invention, it is not 
necessarily limited to the various approaches mentioned above, and it cannot be 
overemphasized conventionally that each well-known smoothing approach can be applied. While 
the result processed by data smoothing is shown by drawing 4 (c), the noise component of a 
noise field including Field A and Field B with noise mottle, and Field C is controlled and the 
profile wave shown in drawing 4 (a) becomes smooth at it, it is the field El where ah edge 
component is dominant. And field E2 Even if it attaches, it turns out that an edge signal is 
controlled and it has; become a smooth profile wavie: 

0042 Subsequently; the extract process (step 104) of ah edge noise mixture component is 
explained, smooth image data IAV (x y) obtained to the smooth chemically-modifiied degree 
(step 102) Sharpness emphasis image data IS obtained at the sharpness emphasis process 
(step 100) according to the following formula (16) from— mixture component deltalEG (x y) 
which is fine structure data with which it subtracts and the edge by which sharpness emphasis 
was carried out, and a noise are rnterrhingled It extracts. 

deltaIEG(x y) =10 (x y)-IAV (x y) (16) 

Mixture component deltalEG obtained according to the extract process of an edge noise mixture 
component by drawing 4 (d) using the profile wave shown by drawing 4 (b) and (c) (x y) The 
profile wave is extracted. 

0043 Next, ah edge detection process (step 106) is explained. Here, although the edge 
detection by the partial distribution method is explained as; an example of representation as an 
example/ this invention is not necessarily limited to this; 

0044 In case edge detection is performed, concentration conversion by the following 
pretreatments is performed first. Such pretreatrrient is performed for improving the precision in 
the case of the edge detection which the noise which does hot have correlation at R image data 
and G image data which constitute color picture data, and B image data is decreased, and is 
performed henceforth, that is, it was shown in the formula (17) — as — the concentration value 
DR of three colors of R, G, and B of the subject-copy image data 10 (x y), DG, and DB weighting 
factors r, g, and b — hanging — vision concentration (Visual density) DV It changes. 

DV =(rDR +gDG +bDB )/(r+g+b) (17) 

As a weighting factor, a value like r:g:b=4:5:l is used, for example. This conversion is 
performed for decreasing the noise which does not have correlation at R, G, and B, and raising 
the precision of edge detection. Although the range of the size of an array of pretreatment is 
good to use 5x5 or an about 7x7-pixel thing, it is for calculating fluctuation of the image 
concentration within the predetermined array mentioned later, moving using a small array, for 
example, about 3x3 array, within an array. 

0045 In addition, it can ask for the weighting factors r, g, and b in edge detection as follows, 
about a weighting factor, when it observes visually, it is conspicuous (this— a spectrum — 
there is also a view that it corresponds to visibility distribution of-like), namely, it is desirable to 
set it as the optimal value based on the idea that the weighting factor of the image data of the 
large color of contribution is large. Although the experiential weighting factor is called for based 
on the vision assessment experiment etc., there are generally Society of Photographic Science 
and Technology of Japan by which the following values are known as general knowledge 
(granular appraisal method good corresponding to Takashi Noguchi and "psychology as well- 
known reference), 57 (6), and 415 (1994) and it changes with colors, the numeric value near 
the following ratio is shown. 

r:g:b=3:6:l r:g:b=4:5:l (18) 

r: g:b=2:7:l — here — the ratio of a multiplier — if the range of a value desirable as r:g:b was 
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specified, when b is set to 1.0 by r+g+b=10.0, the value of the range of g=5. 0-7.0 is desirable 
as a value of g. However, it is r=10.0-b-g. 

0046 Below, the edge detection by partial distribution of an edge detection process (step 106) 
is explained, detection of an edge — the above-mentioned vision concentration DV Image data 
to nE xnE the partial distribution sigma which is the local standard deviation for every location 
of the using a formula (19) about the image concentration fluctuation within an array, moving 
the array of a pixel — sequential attention pixel (x y) every — the photographic subject edge in 
an image. is detected by calculating. Although what is necessary is just to decide suitably a pixel 
size of an array (nE xnE) in consideration of detection precision and a count load, it is desirable 
to use 3x3 or about 5x5 magnitude, for example. 
0047 

Equation 2 . • 

[x] !D=000004 



However, they are x and y about an attention pixel location. It carries out and is DV (x+i-nE/2- 
1/2, y+j-nE/2-1/2). nE xnE which calculates the partial distribution sigma (x y) It is the 
concentration of a pixel array and is <DV (x y)>. It is the average concentration of the array 
and is Equation 3. . ■ . . 

g] ID=000005 ... . 



It comes out. 

0048 From the subject-copy image data IO, the partial distribution sigma (x y) shown in the 
above-mentioned formula (19) is calculated (x y), and it is the edge reinforcement EO (x y) of a 
photographic subject image. In order to ask, the formula expressed with an exponential 
function like the following type (21) is used. 

EO (x y) =l-exp -sigma(xy)/aE (21) 

however, aE Threshold sigmaT of the partial distribution sigma (x y) which is a multiplier at the 
time of changing the value of the partial distribution sigma (x y) into edge reinforcement, and is 
assigned to edge on^-the-strength EO =0.5 ** — if it carries out aE =-sigmaT/loge (0.5) (22) 
It comes out. sigmaT Although it is necessary to make a value into a suitable value with the 
magnitude of the signal of a noise and a. photographic subject profile, in a color picture with a 
color each of 8 bits (256 gradation), its value of the range of 10-100 is desirable. If this 
conversion is created as a look-up table, it can shorten the computation time which conversion 
takes. 

0049 Edge reinforcement EO (x y) As a transformation for which it asks, it is not limited to the 
above-mentioned formula and other formulas can also be used. For example, the function of a 
GAUSHAN mold like the following type may be used. 

EO (x y) =l-exp {-sigma(x y)2 / aE12} (23) 

however, aEl — sigma (x y) from — EO (x y) Partial distribution sigma (x y) which is a 
multiplier at the time of changing and is assigned to EO (x y) =0.5 a threshold — sigmaT ** — 
if it carries out aE12 =-sigmaT 2 / loge (0.5) (24) 

It comes out. sigmaT in a color picture with a color each of 8 bits (256 gradation), the value of 
a value of the range of 10-100 is desirable. 

0050 Moreover, this edge data EO (x y) on the strength Like the formula (25) shown below, it 
is the greatest partial distribution data sigmaMax. It normalizes and is the one or less or more 0 
data EO (x y) which it normalized edge on the strength. You may obtain. 

EO (x y) = sigma (x y)/sigmaMax (25) 

Here, it is sigmamax. Partial distribution data sigma (x y) It is maximum and is sigma (x y). It 
is a constant for normalizing. sigmaMax Partial distribution data sigma of the whole image 
which searched for the decision approach by the formula (19) from (x y) ~ maximum is 
calculated like the following formula (26). 
sigmaMax =Max {sigma} (x y) (26) 

0051 Moreover, not using the maximum which can be found from the whole image, the above- 
mentioned formula (25) and (26) are used from the image data (about of subject-copy image 
data 1 / four to 1/10) thinned out from the specific range or all the images for a center section 
of the high image of a probability with some images, for example, the important photographic 
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subject of an image, and it is maximum sigmaMax. You may ask. In this case, before the image 
data and the thinned-out image data of the specific range for an image center section perform 
an image processing and obtains processing image data, the various subject-copy image data 
for processing condition adjustment (press can image data) which can be beforehand obtained 
by the coarse pixel consistency may be used for it, and it may extract them from subject-copy 
image data, more — desirable — sigmaMax Partial distribution data sigma (x y) Average <sigma 
of the average of the value included in less than 5 - 10% of high orders at the time of arranging 
in an order from a large value; for example, the value included in less than 10% of high orders, 
>(x y) Maxl0% — sigmaMax ** — carrying out — sigma (x y) This sigmaMax the case where it 
exceeds — all — sigmaMax It replaces. In this case, the average may be the average of the 
image data thinned out also by the average of many oim case the average of the whole 
image or an om porta rat photographic subject is photoed predetermined range for a center 
section. 

0052 By the way, as an edge detection method in this invention, it is not necessarily limited to 
the edge detection method of the above-mentioned partial distribution method, and other edge 
detection methods are available. There is an approach based on primary differential or 
quadratic differential in edge detection methods other than the above-mentioned partial 
distribution method, and the approach of further some is in each. First, there are the two 
following operators as an approach based on spatial primary differential, difference — there are 
an operator of Prewitt, an operator of Sobel, an operator of Roberts, etc. as a mold edge 
extract operator. The operator of Roberts can express with the following type. 

As g(i, j) ={ff(o, JD-lFCo+II, j+ll)2+f(6+D, J>-ff(i, J+fi)2} 1 / a 2 template mold operator, 3x3. 
template equivalent to the edge pattern of eight directions is used. Robinson Operator There is 
an operator of Kirsh. Next, there is an approach using Laplacian as an approach basied on 
spatial quadratic differential. In this case, since a noise is emphasized, after carrying out 
shading-off processing of a normal-distribution mold first, the approach of carrying out edge 
detection is used well. 

0053 subject-copy image data 10 shown in drawing 4 (e) at drawing 4 (a) from — edge data EO 
on the strength called for at the edge detection process The wave is shown. Edge data EO oh 
the strength shown in drawing 4 (a) It sets and is a field El. And E2 It is the edge data EO on 
the strength near. It turns out that the value is large. 

0054 Next, the count process (step 108) of a noise field pile attachment multiplier is explained. 
Edge data EO (x y) on the strength obtained at an edge detection process (step 106) It uses, 
the following formula (27) is followed and it is the weighting multiplier WE (x y) of an edge 
field. Weighting multiplier WG of a noise field after asking (x y) It asks according to the 
following type (28). 

WE (x y) =l-alphaE+alphaE EO (x y) (27) 
W<SUB>G (x,y) =1-WE (x,y) (28) 

0055 Here, it is alphaE. it is the constant which sets up weighting of an edge field and a noise 
field, and an operator can set up or more 0 one or less any value. Weighting multiplier WE (x y) 
of an edge field 1-atphaE It becomes one or less value above, and is WE (x y). It is judged that 
the probability which is the edge field of a photographic subject in the pixel location is so high 
that it is large, and it is WE (x y). It is judged that the probability which is a noise field in the 
pixel location is high, so that it is small. Edge data EO (x y) on the strength which it normalized 
In an edge field with the value near 1.0/ it is alphaE. It is the weighting multiplier WE (x y) of 
an edge field irrespective of a value. It becomes a large value near 1.0 and is the weighting 
multiplier WG of a noise field (x y). It becomes the smallest. Edge data EO (x y) on the strength 
which it normalized on the other hand It takes for becoming smaller than 1.0, and is the 
weighting multiplier WE (x y) of an edge field. Minimum value 1-aIphaE It approaches and is the 
weighting data WG of a noise field (x y); Maximum alphaE It approaches. Such alphaE It is 
alphaE, while it is beforehand set as the fixed value as a default and an operator looks at the 
processing image in which the image processing was carried out by this default. You may make 
it adjust a value if needed. In addition, alphaE Edge data EO (x y) on the strength which it 
normalized when it was 1 Self is the weighting multiplier WE (x y) of an edge field. It becomes 
and is 1.0-EO (x y). Weighting multiplier WG of a noise field (x y) It becomes. 

0056 Weighting multiplier WG of the noise field which can be found in drawing 4 (f) from the 
edge data on the strength shown by drawing 4 (ej (x y) The wave is shown. Field El And E2 It 
is the weighting multiplier WG of a noise field (x y) near. The value is small. In addition, fields 
El and E2 Weighting multiplier WG of the noise field in the neighborhood (x y) A value is 
constant alphaE which sets up weighting of the edge field set up by the above-mentioned 
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formula (27), and a noise field. It becomes settled. 

0057 Next, discernment / separation process process (step 110) of noise data is explained. 
Mixture component deltalEG in which the edge component which was obtained at the extract 
process (step 104) of an edge noise mixture component, and by which sharpness emphasis was 
carried out, and a noise component are intermingled (x y) Weighting multiplier WG of the noise 
field obtained at the noise pile attachment multiplier count process (step 108) as shown in the 
following formula (29) (x y) Multiplication is carried out and it is the noise data GO (x y). It 
asks. 

GO (x y) =deltaIEG (x y) x WG. (x y) (29) 

Mixture component deltalEG shown in drawing 4 (g) at drawing 4 (d) (x y) Weighting multiplier 
WG of the noise field shown in drawing 4 (f) (x y) Noise data GO (x y) obtained by carrying out 
multiplication A profile wave is shown and it is the field El where an edge component is 
dominant. Field E2 It turns out that the signal component of an edge is removed. 

0058 Next, a noise mottle control distribution operation process (step 112) is explained. First, 
noise control distribution function s (r) showing the breadth of the noise control in the pixel of 
the noise field of a subject-copy image is set up like a formula (1). r is a coordinate (x y) made 
into the center position (zero) of the breadth of noise control of Point P here. It is the distance 
from the zero P of an attention pixel in which it is located. 

s(r)= exp(-r/a) (1) 

Namely, s (x y) = exp (-(x2+y2) (l/2)/a) It is expressed. 

0059 Here, a in a top type (1) is a control range constant which adjusts; the range of the 
brieadth of the noise control in the pixel of a subject-copy image, is given beforehand or is set 
up by the input. (Bordering location rs, i.e., control distance, of the range which does noise 
control when the control range constant a is set up by the input Value smin in this location It is 
set up by setting.) namely, control distance rs Value smin from — it calculates and asks for the 
control range constant a by the following formula (30). 

a = -rs /log(smin ) (30) 

0060 Here, it is smin. It is desirable that it is or more 0.1 0.5 or less, and a va|ue is the 
control distance rs. As for a value, it is desirable that it is the value of or more 1 15 or less 
range. When reading with a scanner etc. the image especially recorded on the film and 
obtaining subject-copy image data, as for setting out of the value of the control distance rs, it is 
desirable to change suitably according to granularity that the film which changes with the 
classes and sensibility of a film format (image size of one coma of a film) or a film is 
granular (granular mottle) > and the scan aperture size of the scanner which scans a film 
and obtains digital image data. That is, when coarse granular (granular mottle is also large), it 
is the control distance rs. A value is enlarged and, in the case of the shape of a conversely fine 
grain, it is the control distance rs. A value is made small, moreover, even if it is the same film 
which is suitably changed according to the scan aperture size of a scanner, when it considers as 
the case where the scan aperture of a scanner is 15micrometer**, and lOmicrometer**, even 
when the value of the control range constant a is the same, it is because the pixel consistency 
of the image in the direction of 1.5 times and 10 micrometer** becomes a actual image 
consistency high and grain-like granularity changes. 

0061 Moreover, this control distance rs Noise data GO which will be obtained at step 110 if 
mask size of equalization of a smooth chemically-modified degree (step 102) is enlarged It is 
thie control distance rs in order to control the component of this noise mottle, since the 
component of the noise mottle contained also fades greatly and spreads. It is necessary to 
enlarge. So, it is good to also change the control distance rs suitably according to the mask size 
for equalization of a smooth chemically-modified degree (step 102). When the control range 
constant a is made into a value larger 1.5 times to about 2 times than this mask size although 
the mask size for equalization of a smooth chemically-modified degree makes about 3 pixel x3 
pixel the minimum mask size and about 11 pixel xll pixel is made into the maximum mask 
size, for example, mask size is 3x3, it is the control distance rs. It is desirable to make a value 
about into five. 

0062 A function like a formula (2) as such noise control distribution function s (r) may be set 
up. 

s(r)= exp(-r2 /a.2 ) (2) 

Here, r is the distance from the center position of the breadth of noise control. In this case> the 
control range constant a is the control distance rs. Value smin in that location It uses and asks 
by the following formula (31). 
a = rs /-log(Smin )(l/2) (31) 
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Or a function like the following type (3) as noise control distribution function s (r) may be set 
up. 

s(r)= rect(r/a) (3) 

Here, a value is in the boxcar function of 1 and r of rect (r/a) is the distance from the center 
position of the breadth of noise control. In this case, the control range constant a is the control 
distance rs to set up. It carries out. Moreover, the same noise control distribution function s (r). 
as a formula (1) can be obtained by being referred to as smin =1 in a formula (2) and a 
formula (3). 

0063 Such noise control distribution function s (r) follows the following formula (32), and is 
one or less or more 0 noise control distribution function si (x y). It normalizes, 
si (x,y) = s(x,y) /S (32) 

Here, S is the integral value which can be found by the following type (33). 
Equation 4 

ID=000006 



Noise control distribution function s obtained by drawing 4 ...(h) using a formula (1) (x y) Noise 
control distribution function si (x y) normalized according to the'formula (33) An example is 
shown. 

0064 Next, this noise control distribution function si (x y) and noise data GO (x y) that it 
normalized It uses, finds the integral by collapsing in the range which noise control does like , 
the following type (34), and is the noise mottle control distribution M (x y). It computes. 
Equation 5 

Q ID=000007 



noise mottle control distribution M (x y) computed here A certain attention pixel location (x y) It 
is that for which collapses extent of the control received from other pixels of the noise which 
can be set, and it asks according to ah integral. Subject-copy image data 10 it is; a thing 
equivalent to diffusion distribution of the development inhibitor generated at the time of the 
development of the silver haiide particle in a film sensitization layer in the case of being the 
image data read in the film image with the scanner etc. Noise data GO It considers that 
fluctuation is distribution of the particle of sensitive material, and is the subject-copy image 
data 10. Noise mottle control distribution M equivalent to the diffusion distribution of the 
development inhibitor generated focusing on the silver granule child of sensitive material 
inciuded (x y) It asks. 

0065 Noise data GO shown in drawing 4 (g) when the example shown in drawing 4 explains 
Noise mottle control distribution M as shown in drawing 4 (i) by computing according to a 
formula (34) using the noise control distribution function si (x y) shown in drawing 4 (h) (x y) 
It obtains. Drawing 4 (i) means that the value of noise mottle control distribution becomes large 
in the part shown in the field A in drawing, Field B, and Field C, and the concentration of the 
development inhibitor generated with silver salt sensitive material is high in the parts of this 
field A, Field B, and Field C in silver salt **********. Thus, noise mottle control distribution M 
(x y) It is computed. 

0066 Next, a noise mottle control component operation process (step 114) is explained^ Noise 
mottle control distribution M calculated and computed by step 112 at the noise mottle control 
component operation process (x y) Noise data GO for which it asked at step 110 as shown in 
the following formula (35) By carrying out multiplication, it is the noise control component 
image data Gl (x y). It calculates. 

Gl (x y) = GO (x y) x M (x y) (35) 

0067 Noise mottle control distribution M (x y) Noise data GO Multiplication is carried out for 
taking into consideration controlling according to an operation of the development inhibitor 
generated in silver salt sensitive material, and a silver granule child in the case of silver salt 
sensitive material. At the example shown in drawing 4 , it is the noise control component image 
data Gl (x y) to drawing 4 (j). It is shown. Noise control component image data Gl (x y) shown 
in drawing 4 (j) Noise data GO shown in drawing 4 (g) When it compares, it is the other field El 
in Field A, Field B, and Field C, for example, a field. Field E2 It turns out that it receives and the 
value is large relatively. 

0068 Finally, a noise control image operation process (step 116) is explained.. noise control 
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component image data Gl (x y) for which it asked at step 114 in the noise control image 
operation process Sharpness emphasis image data IS calculated at step 100 after carrying out 
variable power using the noise control multiplier alpha, as shown. in the following formula (36) 
from — it subtracts and asks for processing image data II'. . 
II 1 (x y) = 10 (x y) - AlphaxG 1 (x y) (36) 

Here, the noise control multiplier alpha is a parameter which controls extent of noise control 
and which can be set up, and a setting-out input is suitably carried out. Or a default setting 
value may be established beforehand and you may change if needed. Then, the image data 
suitable for the image output unit 16 is changed, and it is the processing image data II from 
processing image data Il\ Jt obtains. 

0069 Processing image data II 1 as shown in drawing 4 (k) in the example shown in drawing 4 
It turns out that a profile wave can be acquired, a noise is greatly removeB in the field of noise 
mottle, such as Field A, Field B, and Field C, and the noise is appropriately removed also in the 
other noise field. And subject-copy image data 10 shown in drawing 4 (a) It compares and is a 
field El. Field E2 Sharpness emphasis of the edge field is carried out. 

0070 Like the granular component in photosensitive material etc., the above-mentioned image- 
processing approach affects the pixel field where a granular component is fixed, namely, 
although it is effective as an image processing for granular control when affecting the granular 
component whose granular components are other pixels Moreover, the describing above 
image-processing method is effectively applicable from performing blemish defective 
amendment etc. using the image data of other pixels also in the digital camera using CCD which 
is not influenced of the noise component of other pixels, an MOS image sensor, etc. As a CCD 
image sensor, it is applied also to the. thing of a honeycomb array given in JP,10-136391,A. 

0071 In addition, as the image^processing approach for noise control, by J P, 11 -250246, A, 
although, the approach of multiplying a noise component by the compression coefficient for 
which it asked from the edge reinforcement of an image, and controlling a noise is proposed,, 
since a fixed compression coefficient is applied, in a noise field, the amplitude of a noise is 
compressed-like proportionally. Moreover, fluctuation of a noise can also be carried out in the 
direction more uniform than the image-processing approach indicated by the above-mentioned 
official report by adopting the compression coefficient to which compressibility becomes high, so 
that the amplitude of a noise becomes large, i.e., performing nonlinear conversion to the 
magnitude noise (amplitude) of fluctuation. However, the image-processing approach of this 
invention is processing which performs noise control to the noise field A in which fluctuation of a 
noise component is formed greatly spatially, for example, the field shown by drawing 4 (a), 
Field B, and Field C, and fluctuation of a noise can control it more greatly in a large location, 
and, unlike performing control processing to the amplitude of a noise like the two above^ 
mentioned approaches, it can equalize fluctuation of a noise like noise mottle. 

0072 The image-processing approach of this invention is explained as mentioned above. Such 
an image-processing approach may be the program which may constitute as an image 
processing system which consists of a circuit or hardware, and which was mentioned above, or 
demonstrates a function in a computer as software, and may be offered as the record medium 
which the computer which recorded the program for performing the above-mentioned approach 
in this case can read, a CD-ROM, etc. 

0073 The improvement effect remarkable when such an image-processing approach of this 
invention is applied to silver salt color photography, for example, the photograph photoed to 
35mm negative color film, like it is understood for sharpness at a glance as it is granular was 
able to be acquired. Since it had the treatment effect which is equal to the granular 
amelioration by atomization of sensitive material about the shape of a grain especially ; the 
unnaturalness and sense of incongruity "granular tFade amd " which were the fault of various 
kinds of granular clearance approaches based on the conventional equalization or reduction of 
fluctuation were lost. Moreover, about sharpness, the enhancement effect larger than a 
conventional unsharpness mask and the conventional Laplacian filter was acquired by 
combining with the above-mentioned granular control, without worsening the shape of a grain. 
Moreover, when applied also to the image photoed by the digital still camera, the remarkable 
improvement effectivenesis in image quality was acquired like the color picture by the above- 
mentioned silver salt color photography. 

0074 As mentioned above, although the image-processing approach, image processing system, 
and record medium of this invention were explained to the detail, this invention of various kinds 
of amelioration and modification being made is natural in the range which definition is not 
carried out to the above-mentioned example, and does not deviate from the summary of this 
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invention* 
0075 

Effect of the Invention As explained to the detail, according to this invention, as mentioned 
above, by carrying out sharpness emphasis of the subject-copy image first Since a photographic 
subject image, and the both sides of a noise are made sharp, a photographic subject profile and 
a noise component are extracted from the image and a noise component is removed selectively 
The unnatural artifact is not formed in the boundary of a noise rejection field and a sharpness 
emphasis field, either, without not forming the big unevenness which a noise fades and looks 
unpleasant visually, but taking the low picture signal of contrast for a noise. Furthermore, since 
the noise component is controlled when the concentration fluctuation of a noise component 
extracts a coarse field spatially and removes greatly selectively, few (concentration fluctuation 
is small) therefore, concentration fluctuation can be equalized, also spatially, it can also make 
for a processing image to contain coarse large noise components, such as noise mottle, into a 
fine noise, and, also visually, control of a natural noise can be realized. 

0076 Moreover, according to this invention, when a noise is granular, sharpness emphasis of 
the shape of a grain is carried out, and granular components, such as large granular mottle of 
fluctuation, are removed and controlled spatially, and natural granular depressor effect without 
the visual sense of incongruity and the displeasure like the shape of a fine dotage grain with 
which a granular pattern is obtained when a fine grain emulsion is used in the sensitive material 
of a film photo, detailed -izihg and since it is equalized and which is the fault of the conventional 
method become granular and using smoothing is acquired. Moreover, by applying the image- 
processing method of this invention to silver salt color photography sensitive material, there are 
no so-called unnaturalness and so-called sensie of incongruity "granular fade and " which were 
the fault of the conventional granular control art, the shape of a grain is improved, a very 
remarkable improvement effect can be acquired, and big effectiveness is acquired on industry. 



Brief Description of the Drawings 

Drawing 1 It is the block diagram showing one exarriple incorporating the image processing 
system concerning this invention of the system which reads a color photography image, 
performs noise control and the image processing of sharpness emphasis, and outputs a color 
picture with an output unit. 

Drawing 2 It is the block diagram showing one example of the image-processing section which 
performs noise control of the image processing system concerning this invention, and the image 
processing of sharpness emphasis. 

Drawing 3 It is the block diagram showing one example of the image-processing approach of 
this invention. 

Drawing 4 (a) - (k) is drawing showing an example by which image data is processed by the 

image-prbcessing approach of this invention. 

Description of Notations 

10 Color Picture Regeneration System 

12 Picture Input Device 

14 Image Processing System 

16 Image Output Unit 

18 Color and Tune Processing Section 

20 Noise Control Image-Processing Section 

22 Picture Monitor and Image-Processing Parameter Setup Section 
26 Data-Smoothing Section 

28 Edge Noise Mixture Component Extract Section 

30 Edge Detecting Element 

32 Noise Field Weighting-Factor Operation Part 

34 Noise Component Discernment Separation Section 

36 Noise Control Distribution Function Setting-Out Section 

38 Noise Mottle Control Distribution Operation Part 

40 Noise Control Component Operation Part 

42 Noise Control Data-Processing Section 
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Drawing 1 
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Drawing 2 
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Drawing 3 
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